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We introduce a deterministic chaotic system—the Szilard Map—that encapsulates the measure¬ 
ment, control, and erasure protocol by which Maxwellian Demons extract work from a heat reservoir. 

Implementing the Demon’s control function in a dynamical embodiment, our construction sym¬ 
metrizes Demon and thermodynamic system, allowing one to explore their functionality and recover 
the fundamental trade-off between the thermodynamic costs of dissipation due to measurement and 
due to erasure. The map’s degree of chaos—captured by the Kolmogorov-Sinai entropy—is the rate 
of energy extraction from the heat bath. Moreover, an engine’s statistical complexity quantifies the 
minimum necessary system memory for it to function. In this way, dynamical instability in the 
control protocol plays an essential and constructive role in intelligent thermodynamic systems. 
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Synthetic nanoscale machines m, like their macro- 
molecular biological counterparts EHZ], perform tasks 
that involve the simultaneous manipulation of energy, 
information, and matter. In this they are informa¬ 
tion engines—systems with two inextricably intertwined 
characters. The first aspect, call it “physical”, is the 
one in which the system—seen embedded in a material 
substrate—is driven by, manipulates, stores, and dissi¬ 
pates energy. The second aspect, call it “informational”, 
is the one in which the system—seen in terms of its spa¬ 
tial and temporal organization—generates, stores, loses, 
and transforms information. Information engines oper¬ 
ate by synergistically balancing both aspects to support 
a given functionality, such as extracting work from a heat 
reservoir. 

This is remarkable behavior. Though we can some¬ 
times identify it- in a motor protein hauling nutrients 
across a cell’s microtubule highways [5], in how a quan¬ 
tum dot transistor modulates current under the influence 
of an evanescent wave function El® — it is not well un¬ 
derstood. Understanding calls on a thermodynamics of 
nanoscale systems that operate far out of equilibrium and 
on a physics of information that quantitatively identifies 
organization and function, neither of which has been fully 
articulated. However, recent theoretical and experimen¬ 
tal breakthroughs ®®HDHI23 hint that we may be close 
to a synthesis which not only provides understanding but 
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predicts quantitative, measurable functionalities. 

We define an information engine as a system that per¬ 
forms information processing as it undergoes controlled 
thermodynamic transformations. We show that infor¬ 
mation engines are chaotic dynamical systems. Building 
this bridge to dynamical systems theory allows us to em¬ 
ploy its powerful tools to analyze an engine’s complex, 
nonlinear behavior. This includes a thorough informa¬ 
tional and structural analysis that leads to a measure of 
thermodynamic system intelligence. 

By way of concretely illustrating the theory, we intro¬ 
duce an explicit implementation of Szilard’s Engine fl3j 
as an iterated composite map of the unit square that is 
a deterministic, but chaotic dynamical system. The re¬ 
sult is a particularly simple and constructive view of the 
energetics and computation embedded in controlled non¬ 
linear thermodynamical systems. That simplicity, how¬ 
ever, gives a solid base for designing and analyzing real 
information engines. We end giving a concise statement 
of the general theory and applications. 

Background The Szilard Engine is an ideal 
Maxwellian Demon for examining the role of infor¬ 
mation processing in the Second Law m- The engine 
consists of three components: a controller (the Demon), 
a thermodynamic system (a particle in a box), and a 
heat bath that keeps both thermalized to a temperature 
T. It operates by a simple mechanism of a repeating 
three-step cycle of measurement, control, and erasure. 
During measurement, a barrier is inserted midway in the 
box, constraining the particle either to box’s left or right 
half, and the Demon memory changes to reflect on which 
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side the particle is. In the thermodynamic control step, 
the Demon uses that knowledge to allow the particle 
to push the barrier, extracting f P dV = ksT In 2 
work from the thermal bath. (Supplementary Materials 
review this and related thermodynamic calculations.) In 
the erasure step, the Demon resets its finite memory to a 
default state, so that it can perform measurement again. 
The periodic protocol cycle of measurement, control, 
and erasure repeats endlessly and deterministically. The 
net result being the extraction of work from the bath 
balanced by entropy created by changes in the Demon’s 
memory. 

Rather than seeing the Demon and box as separate, 
though, we view it—an information engine—as the direct 
product of thermodynamic system and Demon memory 
OU. Though we follow Szilard closely, he did not specify 
the Demon’s physical embodiment. Critically, we choose 
the Demon’s memory to be another spatial dimension 
of a particle in a box. Thus, we see the joint system 
as a single particle in a two-dimensional box, where one 
axis represents the thermodynamic System Under Study 
(SUS)—the original particle in a box—and the other axis 
represents the Demon memory. We now describe a de¬ 
terministic protocol that implements the Szilard Engine, 
evolving a particle ensemble over the joint state space. 

A Dynamical Engine The Szilard Engine’s 
measurement-control-erasure barrier-sliding protocol is 
equivalent to a discrete-time two-dimensional map from 
unit square I 2 = [0,1] x [0,1] to itself. The engine has 
two kinds of mesoscopic states —states of the particle’s 
location {L ~ x £ (0, <5] , R ~ x £ (<5, 1)} and states of the 
Demon’s knowledge {d~t/£ ( 0 , 7 ], 7? ~ y £ (7,1)} of 
the location—that partition the joint states (x,y) £ I 2 . 

The protocol cycle translates into a composite map 
Tsziiard = 7e o 7c ° 7m of I 2 ; one map for each engine 
step; see Fig. As they operate, they take the joint 

state space from one stage to another around the cycle: 

Measurement: To correlate Demon memory with par¬ 
ticle location 7m takes the A®L and the B®L mesostates 
to themselves, the A®R mesostate to B <g) R, and B®R 
to A ® R: 


7 m(u y) 


(x,y) 

(®,7?E*) 


x < 6, y < "/ or x < 5, y > ”/ 
x > S, y < 7 , 
x > S, y > 7 . 


Thermodynamic control: To extract energy from the 
bath 7c expands both the A and B Demon memory 
mesostates over the SUS’s whole interval: 


Tc{x,y) 


(f ,y) x<5, 

(fEf ,y) x>5. 


Erasure: 7e maps both the A and B Demon mem¬ 
ory mesostates back to a selected Demon memory reset 
mesostate. If that reset state is A , then the mapping is: 

- A , , f(x,yS) y< 7 , 

E ,V \ (x, Sj + f5^7(l - 5)) y> 7- 

This explicit construction establishes that Szilard’s En¬ 
gine is a deterministic dynamical system whose compo¬ 
nent maps are thermodynamic transformations—a piece- 
wise thermodynamical system. The mapping 7s z iiard 
means we can avail ourselves of the analytical tools of 
dynamical systems theory m mi to analyze the Szi¬ 
lard Engine mechanisms. This perforce suggests a num¬ 
ber of more refined and quantitative questions about the 
dynamics ranging from the structural role of the stable 
and unstable submanifolds in supporting information and 
thermodynamic processing and the existence of asymp¬ 
totic invariant measures to measures of information gen¬ 
eration, storage, and intelligence. 

As typically done to establish a known initial state 
for any engineered computing device, we initialize the 
system first using 7e- The result is that 7sziiard becomes 
the well known asymmetric Baker’s Map 7j^ ker (:r, y) = 
7c°7m° 7jf: 

. f (f, Sy) x < 5 , 

TB akei (x,y) = \f x _ s . ,\ 

{{f=l^ + y(l-6)j x>6. 


The familiar stretching and folding action of 7B a ker is 
shown in Fig. SI b) of the Supplementary Materials. Be¬ 
ing a Baker’s map, it is immediately clear that the Szilard 
Engine dynamics are chaotic [15] [16]. 

While the overall composite map 7s z iiard is impor¬ 
tant, considering its complete-cycle behavior alone misses 
much. What is key are the component maps that nom¬ 
inally control a thermodynamic system, with each step 
corresponding to a different thermodynamic transforma¬ 
tion. We now analyze the dynamics to see how the com¬ 
ponent maps contribute to information processing and 
thermodynamics. (Supplementary Materials give calcu- 
lational details.) 

Dynamical Systems Analysis What does chaos in 
the Szilard Engine mean? The joint system gener¬ 
ates information—the information about particle posi¬ 
tion that the Demon must keep repeatedly measuring 
to stay synchronized to the SUS and so extract energy 
from the bath. On the one hand, it is generated by the 
heat bath through state-space expansion during 7c- And, 
on the other, it is stored by the Demon (temporarily) 
and must be erased during 7e- The latter’s construction 
makes clear that it, dynamically, contracts state-space 
and so is locally dissipative. 

With explicit equations of motion in hand, one can 
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FIG. 1. Szilard Engine as a deterministic dynamical system: the Szilard Map 7s z iiard = T^ rase o 7controi ° Treasure- Regions left 
and right of S colored to aid tracking particle location. Rightmost: action of 7g 3 zilard resulting in self-similar (fractal) structure 
in density p; uniform p requires y = yS. These assume the Demon’s reset memory state is A. (Supplementary Materials include 
an animation.) 


directly check, by calculating the Jacobian ctryTBaker, 
that the map is globally area preserving. Moreover, 
the invariant distribution p can be determined from the 
Frobenious-Perron operator mm-- 

K x ',y')= / dxdy 5({x',y') - , y))p{x, y) . 

Jp 

( S (-) here, and only here, is the Dirac delta-function.) 
Calculation shows that p has full support on the unit 
square I 2 and so its fractal dimension is df = 2 for all 
<5 ,7 £ (0,1). The particle density is uniform when, dur¬ 
ing 7e, the Demon’s memory mesostate partition falls 
at 77 = 7 6 . However, when 77 7 ^ 7 6 , the density is not 
uniform, which is reflected in p’s information dimension 
di < dj, |T 6 j Chs. 11-12]. This corresponds to chang¬ 
ing the efficiency of the Demon’s information extraction, 
which we see is reflected in the difference dj — dj. 

The Szilard Map Jacobian also determines its local lin¬ 
earization and so one can easily calculate the spectrum of 
Lyapunov characteristic exponents (LCEs) for the over¬ 
all cycle and so realize the contribution of each protocol 
step. This gives insight into the directions (submanifolds) 
of stability (convergence) and instability (divergence). 
There are two LCEs: one positive A + = H(d) and one 
negative A - = — H(<5), where H(<5) is the (base 2) binary 
entropy function [T7]. (See Supplementary Material for 
details.) Note that energy conservation (7s z iiard’s area 
preservation) is reflected in the exact balance of instabil¬ 
ity and stability: A + + A - = 0. The unstable manifolds 
(parallel the x-axis) support the mechanism that ampli¬ 
fies small fluctuations from the heat bath to macroscopic 
scale during energy extraction (7c)- The stable mani¬ 
folds (parallel the p-axis) are the mechanism that dissi¬ 
pates energy into the ambient heat bath, during erasure 
(Te). 

The overall information production rate is given by 
7sziiard’s Kolmogorov-Sinai entropy [18] . For the 
Szilard Engine, given the well behaved nature of p, 


= J] a>0 A = A + by Pesin’s Theorem 116]. (That is, 
h M = H(<5), directly verified shortly.) This measures the 
flow of information from the SUS into the Demon: infor¬ 
mation harvested from the bath and used by the Demon 
to convert thermal energy into work. Simply stated, the 
degree of chaos determines the rate of energy extraction 
from the bath. 

Computational Mechanics Analysis The Demon 
memory and particle location mesostates form Markov 
partitions for the Szilard Map dynamics [IFl Chs. 7,9]: 
tracking sequences of symbols in { A , B} or in {R, L} (or 
all four pairs {AR, AL, BR, BL}) leads to a symbolic 
dynamics that captures all of the joint system’s infor¬ 
mation processing behavior. We now use this fact to 
analyze the various kinds of information processing and 
introduce a way to measure the Demon’s “intelligence” 
or, more appropriately, that of the entire engine. We do 
this by calculating computational mechanics’ e-machines 
and e-transducers from the engine’s symbolic dynamics 
19, 20]. The overall engine transducer is shown in Fig. 
0 a), that for the SUS particle dynamics in Fig. [S2|]a), 
and for the Demon memory dynamics in Fig. S2 b). 

In addition to explicitly expressing the effective mech¬ 
anisms that support information processing, e-machines 
allow us to quantify the effects of measurement, control, 
and erasure. The engine’s Kolmogorov-Sinai entropy 
can be calculated directly from the e-machines’s causal- 
state averaged transition uncertainty. To quantitatively 
measure the minimal required memory—a key compo¬ 
nent of “intelligence”—for the information engine func¬ 
tioning, we employ the e-machine’s statistical complex¬ 
ity Cft = H[Pr(cr)], where a e S are the system’s causal 
states [TO] and H[-] is the Shannon information [17], 

It is important to emphasize an aspect of the informa¬ 
tion engine e-machine construction: It is stage-dependent 
in that, to fully capture the component operations and 
their thermodynamic effects, the individual maps must 
to taken into account. This observation should be con¬ 
trasted with the symbolic dynamics and particle position 
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FIG. 2. t -Transducers for the symbolic dynamics of the Szi¬ 
lard information engine from the Markov partition of its joint 
state space: (a) The e-transducer for 7sziiard that reads in the 
periodic control signal for measure ( M ), control (C), and erase 
(E). (b) 7sziiard single-state e-transducer: Memoryless over 
the full measure-control-erase protocol. Transitions /3|a : p 
denote reading protocol symbol a, taking the transition with 
probability p, emitting symbol /3. Asymptotic state probabil¬ 
ities are given in parentheses underneath state names. 


e-machine for the overall Szilard map in its Baker’s map 
form. The resulting process arises from stroboscopically 
observing the behavior after driving the engine with the 
three-symbol word MCE. As an example, the particle 
position process’s e-machine is shown in Fig. db); it is 
a biased coin—a single-state e-machine with no memory: 
C^(7Baker) = 0. This is as it should be: The overall cy¬ 
cle must return to the same state storing no memory of 
previous cycles. 

Computational mechanics analysis shows that, over 
the three-step cycle, the Engine has an entropy rate of 
= H(<5) as seen above (or H(<5)/3 per map step) and a 
statistical complexity of C M = log 2 3 + H(<5). (See Supple¬ 
mentary Materials for details, including analysis of SUS 
and Demon subsystems.) How predictable is the Engine’s 
operation? The information in its future predictab le from 
its pastMs given by the excess entropy. E = \[Z : 
where Z is the past and is the future of the joint pro¬ 
cess over random variable Z t € {A, B} ® {R, L}. We see 
that the machine in Fig. §a), driven by the protocol, is 
counifilar and so E = [21] ■ 

Thermodynamics During each protocol step the En¬ 
gine interacts thermodynamically with the heat bath. 
The Supplementary Materials calculate the average heat 
( Q) and work ( W) flows between the Demon and the bath 
and between the SUS and the bath during each step. For 
the Szilard Engine heat and work are equivalent and so 
we discuss only the heat as energies (Qdiss) dissipated to 
the bath for each interaction. As we will see, although 
7 —the Demon memory partition—did not play a direct 
role in the informational properties, it does in the ther¬ 


modynamics. 

The expected heat flow during measurement is 

(Qmeasure) =-fcsT(l-(5)ln((l-y)/ 7 ). Since 7 £ [0,1], 

the dissipated heat can be negative or positive. It van¬ 
ishes at 7 = 1/2. Negative dissipated heat means that 
the engine absorbs energy from the heat bath and, in that 
case, turns it into work. The work f P dV done by the 
particle on the barrier is k B T H(<5) In 2. Thus, the average 
heat absorbed by the engine from the heat bath during 
thermodynamic control is (Qcontroi) = — fesTH(i5) In 2, 
which is maximized when 5 = 1/2. During memory era¬ 
sure the Demon shifts back to its default state, without 
affecting the SUS state. The barrier partitioning the De¬ 
mon’s mesostates slides, compressing the contained par¬ 
ticle into the default state A, say. The heat dissipated 
in this process is (Q erase ) = k B T(l - 6 )ln((l - 7 V 7 ) + 
k B TR{5) In 2. 



0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 

7 

FIG. 3. Beyond Landauer’s Principle: Thermodynamic costs 
(energy dissipation Qdiss) for measurement, control, and era¬ 
sure in Szilard’s information engine as a function of 7 (Demon 
partition) with SUS barrier at <5 = 1/2. Landauer’s Principle 
applies only at 7 = 1/2 (vertical yellow band): measurements 
are thermodynamically free, erasure costs since heat is dissi¬ 
pated as a result of Demon resetting. Costs exactly flip at 
7 = 4/5, though. 

While the heat dissipated during control is indepen¬ 
dent of 7 , both measurement and erasure can dissipate 
any positive or negative amount of heat, depending on 
7 . Notably, for 7 > 1/2, the Szilard Engine violates 
Landauer’s Principle [221 23] in that (Q erase ) < In 2; in 
energy units of k B T. Indeed, for 7 = 4/5, erasure is 
thermodynamically free and measurement is costly—an 
anti-Landauer Principle. 

Figure [3] illustrates the trade-offs in thermodynamic 
costs for each step. They sum to zero and so the En¬ 
gine respects the Second Law over the whole range of 
S and 7 . The erasure and measurement steps together 
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obey the relation. (Qerase) T (^measure) — kgT H((^) In 2, 
recovering trade-offs noted previously [24U27] . That is, 
the Szilard Engine achieves the lower bounds on energy 
dissipation during measurement and erasure. And so, it 
plays an analogous optimal role in the conversion of infor¬ 
mation into work as the Carnot Engine does for optimal 
efficiency when converting thermal energy to work. 

Final Remarks We leveraged a straightforward ob¬ 
servation to give a thorough dynamical systems, compu¬ 
tational mechanics, and thermodynamic analysis of Szi¬ 
lard’s Engine: an information engine’s intrinsic computa¬ 
tion is supported by the evolution of its joint state-space 
distribution and its thermodynamic costs monitor how 
those distributional changes couple energetically to its 
environment. 

The Szilard Map construction is straightforward and 
easy to interpret. For these reasons, we selected it to 
illustrate the bridge between thermodynamics, informa¬ 
tion theory, and dynamical systems necessary to fully 
analyze information engines. The approach generalizes. 
We can now state our central proposal: (i) an informa¬ 
tion engine is the dynamic over a joint state space of a 
thermodynamic system and a physically embodied con¬ 


troller, (ii) the causal states of the joint dynamics, formed 
from the predictive equivalence classes of system histo¬ 
ries, capture its information processing and emergent or¬ 
ganization, (iii) a necessary component of the engine’s 
effective “intelligence”, its memory, is given by its statis¬ 
tical complexity C^, (iv) its dissipation is given by the 
dynamical system negative LCEs, and (v) the rate of en¬ 
ergy extracted from the heat bath is governed by the 
Kolmogorov-Sinai entropy h 

Sequels use this approach to analyze the informa¬ 
tion thermodynamics of more sophisticated engines, in¬ 
cluding the Mandal-Jarzynski ratchet [28], experimental 
nanoscale information processing devices, and intelligent 
macromolecules. 

Supplementary Materials: Calculational details, fur¬ 
ther discussion and interpretation, and animation illus¬ 
trating a continuous-time embedding of 7sziiard- 
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Supplementary Materials 

I. SZILARD MAP CONSTRUCTION DETAILS 

Here, we mention several details underlying the construction of 7sziiard and 7B a ker- There is, in fact, a family 
of related maps. Partly, this comes from the incompleteness of Szilard’s presentation [ST] : partly, due to possible, 
permitted variations in implementation. The following comments only hint at these variations. A sequel will develop 
them more systematically. 

Erasure: 7e maps both the A and B Demon memory mesostates back to a selected Demon memory reset nresostate. 
If that reset state is A, then the mapping is: 


Te 0 , 2 /) 


(x, yS ) 

(Mt+ i=y7(l - <*)) 


If the reset state is B , then the mapping is: 


y < 7 . 
y > 7 • 


(x, y) 


(a:, 7 - 2 /+* (1-5(1 - 7 ))) 
(x, 1 — <5(1 — y)) 


y <7 , 

y > 7 • 


T B 

'E 


The cell boundary required by area preservation (probability invariance) under map 7jd is y' = £7 and for map 


y' = 1 — 5(1 — 7 ). The reason for this is that during the control operation horizontal stretching by 5 _1 or by 
(1 — 5 ) _1 “dilutes the gas” or reduces the probability density. To maintain probability invariance (or “gas density”) 
we must compensate in the erase operation by multiplying the Demon (vertical) coordinate by S or 1 — <5. 

Full cycle operation: The overall information engine cycle, then, is the map given by the composition of the 
component maps: 7s z iiard = Tgf 0 7c 0 7m- The action of 7s z iiard is shown in Fig. SI 'a), where rj = jS. The map is 
area preserving, as is verified below by calculating the determinant of its Jacobian. 

Initial-reset engine: If one first resets the engine with 7jy, then we obtain the familiar Baker’s Map Teaker = 
7c 0 7m 1 


°% A - 


•E ‘ 


f(f, Sy) x < S , 

rBakei ^y )= \^,5 + y(l-S)) x>5. 

It’s action on the joint state space is show in Fig. 13b). 

Due to several choices in the construction of the component maps, the two distinct Tsziiard maps that individually 
require proper initialization (reset to A or reset to B) can be combined into a single, more general 7sziiard that does 
not. The resulting map simply operates on what it is given as initial conditions (£ 0 , 2 / 0 ) € I 2 - Mesostates in one or 
the other reset memory are properly transformed. This composite map is: 


Tsziiard (£5 V ) 


'(! ,Sy) 

fe, <57 + 2/(1- 6)) 

* ft,+ ^ 7(1 -*)) 

X&^'ys) 


x <6, y < 7 , 
x> 5, y < 7 , 
x <6, y> 7 , 
x > 5, y > 7 . 


II. SZILARD ENGINE DYNAMICAL SYSTEM: AN ANIMATION 

Probably the most direct way to understand the operation of Szilard’s Engine is via a continuous-time embedding 
of Tsziiard• Animations can be viewed at http://csc.ucdavis.edu/~cmg/compmech/pubs/dds.htm 

Here, we provide accompanying descriptive text that addresses several issues: How the discrete-time 7sziiard is 
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FIG. SI. Dynamical Szilard Engine Composite Maps: (a) Szilard Map 7sziiard = 72) aae o 7controi ° "/Measure and (b) Asymmetric 
Baker’s Map TBaker = 7controi ° '^Measure ° T^. ase . These assume the Demon’s reset memory state is A. Areas left and right of S 
are colored only as an aid to understanding the maps’ action and to track the particle location history. 


embedded in continuous time, what the protocol cycle looks like in operation, where the instability and chaos occur 
(during energy extraction), what erasure affects, and, notably, the appearance of self-similar (fractal) structure in the 
joint state-space distribution. 

Background: In 1929 Szilard [Si] gave Maxwell’s Demon its first logical resolution—that “intelligence” was not 
violating the Second Law- by accounting for the Demon’s own, what we now call, information processing: 

... we must conclude that the intervention which establishes the coupling between y and x , the measure¬ 
ment of x by y, must be accompanied by a production of entropy. 

(Cf. Smoluchowski’s “physical” resolution [S2HS4] .) 

Szilard Engine Operation: There are two ways to describe the Engine’s operation: as its action on a single particle 
or that on an infinite ensemble of particles via evolving a probability density. The graphics and animations show the 
latter. The former is easier to describe, initially. 

Consider a single particle in a box, whose position the Demon determines by placing a partition at x = 5. Then, 
noting on which side (left or right) the particle falls, the Demon lets the particle push the partition (right or left, 
respectively) to extract energy (fj P dV or f~ J P dV, respectively). (See Sec. [vjfor the thermodynamic calculations.) 
The entire system is held at constant temperature T by a heat bath. Finally, the Demon’s memory is reset to its 
original state (mesostate A or B). 

Our construction of 7sziiard demonstrates that Szilard’s Engine is, in fact, a deterministic chaotic map of the unit 
square I 2 = [0,1] x [0,1]. The construction “symmetrizes” the Demon and System Under Study (SUS). (The latter is 
the name for the particle-in-a-box thermodynamic subsystem.) That is, we look at the joint state-space of both the 
Demon and SUS. 

Interpretation: In the ensemble view, information processing describes changes in the support and shape of the 
joint state-space distributions. The thermodynamics describes the energy flow to/from the heat bath during each 
protocol step. 

Animation: This is a continuous-time embedding of the 2D map. Suspending a discrete-time map in a continuous¬ 
time flow is a standard, if somewhat under-utilized, visualization technique (S5j . 

The animation shows the evolution of the Engine state-space distribution, beginning when the Demon starts in 
its “reset” mesostate A. Two pieces of the distribution are colored to correspond to the particle in the left or right 
side of the partition placed at x = S. This is an aid to visually track the particle’s location and also to highlight the 
component maps’ actions on areas. 

The animation steps through the protocol (i) Measurement (Demon memory state and particle location come into 
correlation), (ii) Control (extract energy from heat bath), and (iii) Erase (clear Demon memory to start the cycle 
anew). 

The parameter 7 £ [0,1] represents the division between Demon memory mesostates A and B. 

7 and 5 together let us explore the “efficiency” of Demon measurements of particle location. 

The energy extraction (“gas expansion”) corresponds to the state-space stretching during the thermodynamic 
control step 7c- This is particularly noteworthy: The instability of chaos is essential to energy extraction. 

Crucially, one sees another consequence of the chaotic dynamics: The build-up over each cycle of the self-similar 
(fractal) structure of the joint state-space distribution. 
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The construction allows one to make a solid connection between thermodynamics, information processing, and 
chaotic dynamics. Indeed, everything can be analytically calculated. Leaving few, if any, remaining mysteries for the 
Szilard Engine, as originally conceived. In this light, Szilard’s conclusion takes on new meaning [SI) : 


... a simple inanimate device can achieve the same essential result as would be achieved by the intervention 
of intelligent beings. We have examined the “biological phenomena” of a nonliving device and have seen 
that it generates exactly that quantity of entropy which is required by thermodynamics. 


With this firm foundation, designing and analyzing more sophisticated thermodynamic control systems becomes 
possible, including monitoring information creation and the necessary attributes of “intelligence”. 


III. SPECTRUM OF LYAPUNOV CHARACTERISTIC EXPONENTS 

The Szilard Map Jacobian <9a;y7sziiard determines its local linearization and so one can easily calculate the spectrum 
of Lyapunov characteristic exponents (LCEs) for each thermodynamic step and for the overall cycle [S15t IS16] . This 
gives insight into the directions (submanifolds) of stability (convergence) and instability (divergence). We work with 
7Baker- There are two LCEs. We find that one is positive: 

A+ = lim r 1 log 2 I (*^0 , Z/o) ‘ 8x\ , 

t—¥ OO 1 1 

where, since the unstable manifolds parallel the x-axis, the initial vector is Sx = (1,0). Due to ergodicity, we can 
calculate via: 


A + = / dx 
Jo 

= m- 


n\ /»<5 /»1 

dx dy p log 2 6 + dy p log 2 (l - 5) 
Jo Jo Js 


There is no dependence on initial condition ( xo,yo ) £ I 2 . There is a companion negative LCE that monitors state 
space contraction. Since the stable manifolds parallel the y-axis, we take the initial vector 8y = (0,1), finding: 

A - = lim r 1 log 2 \d xv T^ aVe ,{xo,yo) ■ Sy\ 

£—>■00 

= -m- 


Note that state-space area preservation is reflected in the exact balance of instability and stability: A + + A - = 0. 
More specifically, the unstable manifold supports the mechanism that amplifies small fluctuations from the heat bath 
to macroscopic scale and so to extractable work. The stable manifold is the mechanism that dissipates energy into 
the ambient heat bath, due to Demon memory resetting. 


IV. INTRINSIC COMPUTATION CALCULATIONS 

We can project the global symbolic dynamics, captured by the e-transducer of Fig. §a), onto just that for the 
Demon (over alphabet {A,B}) or just that for the SUS (over alphabet {L,R}). The SUS and Demon e-transducers 
are shown in Fig. [S§a) and^b), respectively. Comparisons are insightful. 

The projections make it clear that the SUS and Demon e-transducers are duals of each other. When one splits into 
multiple causal states, the other contracts its causal states, as expected. Branching and contraction must be balanced 
in a state-space volume preserving system. 
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Computational mechanics analysis shows that the SUS system has an entropy rate of: 

hf s = H[X|S] 

= - E P ''M E Pr(x|u) log 2 Pr(:r|er) 

aes SDS xe{L,R } 

= H(J)/3 , 

where <S sus is the set of its causal states, and a statistical complexity of: 

Cf s = H[Pr(<S)] 

= - ^2 Pl '( CT ) Pr ( a ) l0 §2 Pr ( cr ) 

<7 G5 sus 

= log 2 3 + 2/3H(<5) . 


Note that the time scale here is measured in individual protocol steps. 

The Demon’s memory process has the same entropy rate /jj/ emon = H(<5)/3, but different statistical complexity 


C, 


Demon 


= log 2 3 + 1/3 H(£). 


For the overall Szilard information engine (Fig. 21a)) we find that it has the same 


entropy rate ^Szilard _ H(5)/3, but statistical complexity U® zllard = log 2 3 + H(5). The analysis shows us that the SUS 
and the Demon subsystems are not independent, however. The joint C^iiard substantially less than the sum of that 
of the two subsystems: C® zlIard = C® us + Cj 1 ™ 011 — log 2 3. Not surprisingly, the two subsystems are redundant in 
their operation. The log 2 3 bits of memory reflect the synchronization of SUS and Demon during the period-3 control 
protocol, which is accounted for only once in the overall Engine C® zllard . 

An information engine is a control system and its effectiveness depends on the controller (Demon) knowing the 
state of the thermodynamic subsystem (SUS). So, how predictable is the SUS from the Demon’s perspective? And, 
for that matter, since our construction is symmetrized, the Demon from the viewpoint of the SUS? The answers 
sta rt with the information engine’s past-future mutual information, the excess entropy: E Szllard = I[Z;~^], where 
Z = ... Z_ 3 ^_ 2 ^-i is the past and = Z§Z\Zi ... is the future of the joint process over random variable Z t £ 
{A, B} ® {R } L}. E Szllard measures the amount of future information predictable from the past. We can also ask 
about the predictability of the individual SUS and Demon subprocesses using E sus and E Demon , respectively, defined 
similarly. We see that the machines in Fig. S2 are counifilar iSTi IS21] and so E Szllard = C l ® zllard , E Demon = C® emon , 
and E sus - (7 SUS IS2I1. fSection 


VI 


calculates the inter-subsystem information flows.) 


V. ENGINE THERMODYNAMICS 


The minimum energy cost of the measurement, control, and erasure protocol steps can be calculated by treating 
the Szilard Engine as a box of ideal gas. (Sequels address more realistic models of the working fluid.) Each of the 
transitions shown in Fig. [T] is achieved by isothermal sliding of barriers, so the work done is exactly calculable by 
integrating the force on these barriers. The work done on this system is equal to the heat dissipated, since the thermal 
energy of the particle does not change for an isothermal process. 

For each component-map thermodynamic transformation, the work done on the system is given by W = — f PdV, 
where P = k B T/V for a single particle. Thus: 


W = - f 1 k 4y-dV = k B T In V ° 
Jv 0 


V 


Vi 


where Vq is the initial volume of the region being manipulated and V\ is the final volume. 

Assume the Demon resets to mesostate A. 

To calculate the thermodynamic cost of measurement (Qmeasure): note that there are two regions where the particle 
can exist. The particle starts in a uniform distribution over the L® A and R® A regions. The probability of being in 
each of those regions is proportional to the the region’s volume. Assuming the box has volume V, the size of region 
L® A is 5^V and the size of region R® A is (1 — 6) 7 V. Thus, before measurement, the probability of being in R ® A 
is (1 — S). 
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(a) SUS e-transducer. (b) Demon e-transducer. 


FIG. S2. e-Transducers for the symbolic dynamics of the Szilard information engine from the Markov partition of the Demon 
and SUS state spaces: (a) e-Transducer for the thermodynamic system, giving the {!?, L}-symbolic dynamics of particle location 
when the engine’s e-transducer is driven by the period-3 measurement protocol: M —} G —► E —» .... (b) e-Transducer for the 
Demon’s memory, with the engine similarly driven, e-Transducer transitions /3\a : p denote taking a transition with probability 
p on seeing a = {M,E,C} and emitting symbol /3 £ {R, L} or f3 £ {A, B}. Asymptotic state probabilities are given in 
parentheses underneath state names. 


The region L <S> A is unchanged under the measurement map 7m, meaning that there is no work done in the case 
where the particle is on the left. However, if the particle is on the right, volume is being moved to the R<S> B region, 
so we have a change in volume. The resulting average work done is the average dissipated heat: 


(Q measure) (HTneasure) 


= Pr(1/ (g> A) x 0 + Pr(i? <g> A) x 
Vr®a 


PdV 


'Vk®a 


= 0 + (1 — S)k B T In 
= —ksTiyl — (5) In 


Vr®b 

1-7 

7 


Before the thermodynamic control transformation 7c, the particle has probability d of being in the L <S) A region 
and probability 1 — <5 of being in the R<g> B region. If the particle is in the L® A region, then after control the particle 
occupies the whole A region, and if it was in R ® B, then it occupies the whole B region. According to the change in 
volume, the average heat dissipated is: 


(Qcontrol) — (Ibcontrol) 


= — Pr(L <g) A) [ 

J\ 


Vl®a + Vr®a r ji 


Vl®a 


V 


By 


dV-Pr(RoB) [ 

J\ 

U(l- 7 ) 


Vr®b+Vl<2>b l 


Vr®b 


V 


dV 


= yy— <1_ s > t -’ T,a i, ( i _ j)( i _ 7) 

= —k B T{—5 In 5 — (1 - 6) ln(l - 6)) 

= -k B T In 2 H(5) . 


Before the erasure transformation 7e, the particle has probability <5 of being distributed uniformly over the A region 
and probability 1 — <5 of being distributed uniformly over the B region. The B region is compressed into the region 
between 77 = y<5 and 7 on the vertical demon axis, which has volume y(l — S)V. The A region is compressed between 
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0 and r] on the Demon axis, which has volume 7 5V. The associated heat dissipation is, then: 


(Q erase) — (W^erase) 


/*7(1-<5)V 1 rp pySV 1 rp 

= - Pr {B) / -^y-dV - Pr(A) / ~4^dV 


/(1- 7 )V 


V 


J'yV 


v 


= -k B T{{ 1 - <5) In ^^ + <5 In 5) 

1-7 


= k B T In 2 H(5) + k B T( 1 - 5) In 


1-7 


After erasure, the particle is once again uniformly distributed over the A region. 

We close by commenting on the main text’s mention of the Szilard Engine’s optimality. We note that the results 
above match those in Ref. IS27] for S = 1 / 2 . Moreover, they achieve the bounds described there for all S and 7 . 
Specifically, for <5 = 1/2, our results match Eq. (7.23) for erasure and Eq. (7.40) for measurement. And, our results 
achieve the lower bounds given there in Eqs. (7.41), (7.43), and (7.44), since Iqc = H{8). Our development, though, 
places measurement, control, and erasure on the same footing, allowing us to make the same statements about each, 
which is that we quantify how much heat they dissipate. 


VI. MONITORING CORRELATION AND COORDINATION DURING THE CONTROL PROTOCOL 


There are many different correlations potentially relevant to Demon functioning and to monitoring its interaction 
with the SUS. Let Y be the random variable for the Demon’s memory {A, B}. Let X be the random variable for the 
SUS’s particle locations {L,R}. Let S y be that for Demon’s causal states (Fig. S2'b)) and S x that for SUS’s causal 
states (Fig. |S2|(a)). 

The first mutual information we consider is the asymptotic communication rate between the Demon and the SUS: 


lim 

^—>•00 


I[Ap;i; 1q:i] 
£ 


(SI) 


where the random variable blocks are Xq.j = X§X\.. .Xt_\ and Yq-j = YqYi .. .Y(-i. This can be evaluated by 
breaking it into components: 


lim 

OO 


I[Ap : f, Y 0: (\ 

£ 


lim \ (H[A' 0: <] + H[y 0 :/] - H[X 0 :* Yo-i]) 

l —>00 t 

H(<5)/3 + H(<5)/3-H(£)/3 


= H(<S)/3 . 


Note that the Shannon (base 2) binary entropy function H(i5) [S9j features prominently in the expressions for heat 
dissipation. However, the above shows that it often signifies an amount of shared or mutual information, not just a 
degree of Shannon information uncertainty. These two interpretations are rather distinct. 

This should be compared to single-symbol (length-1 block) mutual information between the Demon and SUS: 


Trv V1 <5(2 + 5), 2 + 8 , (1-5X1 + 5), 1 + 5 

I[A 0 ; To] =- 5 -log 2 +- 5 -l«g 2 


3 1 + 5 ’ 3 

5(1-5) (1 ~ 5) (2 — 5) 

3 3 


2 + 5 


log 2 


2-5 
2-25 ‘ 


(52) 

(53) 


Note that this differs from the asymptotic rate above and so the single-symbol quantity misestimates the degree of 
Demon-SUS correlation. 

To measure the degree of internal coordination between the SUS and the Demon, consider now the single-symbol 
mutual information between the SUS and Demon causal states. First, we find the stationary distribution over the 
causal states in the joint process (Fig. |2](a)) and label the joint causal states with the corresponding causal states of 
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the SUS and Demon. The resulting single-state mutual information is: 

I[5 0 x ;^']=log 2 3. 

This tells us the correlation between SUS and Demon causal states is limited to their synchronization within the three 
step cycle of measurement, control, and erasure. 

We can similarly calculate the correlation rate between the Demon and SUS states. For this we need the 
e-transducers for the joint, Demon, and SUS processes in Figs. [2ja) , S2'a), and S2'b), respectively. It turns out 
that the entropy rate for all three machines is also H(<5)/3 as well, so: 


lim 

^—>•00 


i [s-^sr 


0-.V oU = H(<5)/3 + H(<5)/3 - H(<5)/3 
= H(5)/3. 


This equals the communication rate between the Demon and SUS symbolic processes above, indicating that there is 
little “hidden” internal state information compared to the symbolic processes. The Szilard Engine is not a cryptic 
process [S 6 ] . 

Last, adopting the transducer perspective, we calculate the single-symbol conditional mutual information between 
the Demon and SUS variables given the three possible control protocol inputs. These monitor the dependence of 
correlation during the individual protocol steps. Let our input control variable be Z over alphabet {M, C, E}. For 
instance, during the measurement step, we directly calculate: 


l[X 0 -Y 0 \Z 0 = M) 


Y Y Pr ( X o = X, Y,J = y\z 0 = M) log 2 

y&{A,B} xe{L,R} 


( PijX 0 = x,Y 0 = y\Z 0 = M) 
\Pr(A' 0 = x\Z 0 = M) Pr(F 0 = y\Z 0 = M) 


m. 


Similarly, we calculate that during erasure there is no correlation: 

l[X 0 ;Y 0 \Z 0 = E] = 0 , 


and that during thermodynamic control the same holds true: 


I[X 0 ;Y 0 \Z 0 = C\ = 0 . 

Thus, the single-symbol correlation between Demon and SUS comes from measurement. There is also a connection 
between these quantities and the work extracted during control. The work extracted in control is (W) = ksT H(<5) In 2. 
That is, the Engine uses the decrease in correlation of mesostates between measurement and control to extract work 
from the thermal bath. 

Note that these calculations for the Szilard Engine are straightforward. We detail them here to show the individual 
analyses, uncluttered by distracting calculational moves, that one must do for more complex information engines. 
In the latter cases, especially when the thermodynamical system is nonhyperbolic, the calculations can be quite 
challenging. Sequels illustrate. 
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